The MusicBrainz Database is built on the PostgreSQL relational database engine and contains all of MusicBrainz' music metadata. This data includes information about artists, release groups, releases, recordings, works, and labels, as well as the many relationships between them. The database also contains a full history of all the changes that the MusicBrainz community has made to the data. Core data Artists Name, sort name, IPI, aliases, type, begin and end dates, disambiguation comment, MBID...
39,433
39K
data
eye 39,433
favorite 7
comment 3
(Here is the original Reddit comment announcing this collection of data and what the processes were.) This is an archive of Reddit comments from October of 2007 until May of 2015 (complete month). This reflects 14 months of work and a lot of API calls. This dataset includes nearly every publicly available Reddit comment. Approximately 350,000 comments out of ~1.65 billion were unavailable due to Reddit API issues. Q: How are the files structured? Each file is compressed with bzip2 compression....
favoritefavoritefavoritefavoritefavorite ( 3 reviews )
31,813
32K
Jul 12, 2015
07/15
by
Gwern Branwen
data
eye 31,813
favorite 7
comment 0
Dark Net Markets (DNM) are online markets typically hosted as Tor hidden services whose users transact in Bitcoin or other cryptocoins, usually for drugs or other illegal/regulated goods; the most famous DNM was Silk Road 1, which pioneered the business model. From 2013-2015, I scraped/mirrored on a weekly or daily basis all existing English-language DNMs as part of my research into their usage, lifetimes/characteristics, & legal riskiness; in addition, I made or obtained copies of as many...
Topics: Tor, Bitcoin, drugs, Silk Road, Evolution, Agora, black-markets, dark net markets
25,794
26K
Mar 24, 2013
03/13
by
DISCOGS.ORG
This is an unofficial mirror of the DISCOGS.ORG data collection, which is located at http://www.discogs.com/data/ . Discogs, short for discographies, is a website and database of information about audio recordings, including commercial releases, promotional releases, and bootleg or off-label releases. The Discogs servers, currently hosted under the domain name discogs.com, are owned by Zink Media, Inc., and are located in Portland, Oregon, USA. Discogs is one of the largest online databases of...
17,736
18K
Nov 13, 2014
11/14
by
Internet Archive
data
eye 17,736
favorite 7
comment 1
Culled from various sources, this collection includes over one million JPG, PNG and GIF album covers. The resolution ranges from "thumbnail" through to very large sizes. Filenames are variant in usefulness, although a good number indicate at least the name of the original album. This dataset is for experimentation and image processing research only. At 148gb, the collection is large but not unmanageable (there is a torrent available) and allows a developer or artist to work with the...
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topics: dataset, big data, album covers, covers, cover art, cover photos
15,371
15K
May 14, 2013
05/13
by
Anonymous
Abstract While playing around with the Nmap Scripting Engine (NSE) we discovered an amazing number of open embedded devices on the Internet. Many of them are based on Linux and allow login to standard BusyBox with empty or default credentials. We used these devices to build a distributed port scanner to scan all IPv4 addresses. These scans include service probes for the most common ports, ICMP ping, reverse DNS and SYN scans. We analyzed some of the data to get an estimation of the IP address...
11,019
11K
Jun 18, 2014
06/14
by
NYC Taxi and Limousine Commission
data
eye 11,019
favorite 2
comment 0
FOIA/FOILed Taxi Trip Data from the NYC Taxi and Limousine Commission 2013. Released by http://chriswhong.com/open-data/foil_nyc_taxi/ trip_data.7z and trip_fare.7z are more efficiently compressed versions of the data, you probably want these files. The data is in csv format. For the data files this includes the fields: medallion, hack_license, vendor_id, rate_code, store_and_fwd_flag, pickup_datetime, dropoff_datetime, passenger_count, trip_time_in_secs, trip_distance, pickup_longitude,...
Topics: data, nyc, taxi, fare, csv, FOIA, FOIL
Source: torrent:urn:sha1:6c594866904494b06aae51ad97ec7f985059b135
7,483
7.5K
Jun 20, 2016
06/16
by
ACADEMICTORRENTS.COM
Welcome to Academic Torrents! Making 14.15TB of research data available. We've designed a distributed system for sharing enormous datasets - for researchers, by researchers. The result is a scalable, secure, and fault-tolerant repository for data, with blazing fast download speeds.
4,958
5.0K
data
eye 4,958
favorite 1
comment 0
I took the Reddit comment archive and converted all the JSON into one SQLite database using this program that I wrote: https://gist.github.com/ers35/3b615a75fa0ed5e6d5cc I ran a few tests to make sure the number of database rows matches the number of JSON records. "SELECT MAX(rowid) FROM comment" and "SELECT COUNT(id) FROM comment" both return 1659361605. This gives me some confidence as to the integrity of the dataset, but I cannot be 100% sure. The compressed size is 163G....
3,918
3.9K
May 30, 2017
05/17
by
Weiwei Zhang, Jian Sun, and Xiaoou Tang
data
eye 3,918
favorite 2
comment 0
This dataset mirrored from http://137.189.35.203/WebUI/CatDatabase/catData.html, which circa May 2017 is a dead link. The original page is available in Wayback: https://web.archive.org/web/20150520175645/http://137.189.35.203/WebUI/CatDatabase/catData.html The CAT dataset includes 10,000 cat images. For each image, we annotate the head of cat with nine points, two for eyes, one for mouth, and six for ears. The detail configuration of the annotation was shown in Figure 6 of the original paper:...
Topics: cats, datasets, computer vision
3,292
3.3K
data
eye 3,292
favorite 0
comment 0
Large sets of malware examples for the purposes of research, comparison, and history. This is the Various set, which is a volume of specific smaller sets of malware.
2,679
2.7K
software
eye 2,679
favorite 1
comment 0
All the "journal article" DOIs from CrossRef's OAI-PMH server; URLs of just under 50 million journal articles.
Topics: doi, dataset
2,341
2.3K
May 18, 2018
05/18
by
Ben
data
eye 2,341
favorite 0
comment 0
Ben's FTP List (May, 2018): This is a trimmed down list of all servers that are online and allow anonymous connections. There are 244441 FTP's in total Please note: It is unknown if these servers are online after the scan or are behind dynamic IP addresses, making it impossible to guarantee if they are available after this list was compiled. This census is provided as a series of bzip2 files, which can be read directly by utilities such as zmore and zless. It is both intended to be used for...
The Data Commons Pilot Phase Consortium (DCPPC) is an NIH project to tackle the challenges of data-driven and data-intensive biomedical research: The data sets are too large to download There's minimal interoperability between and across data set providers Local compute capacity often is too limited to meet dynamic research needs These challenges are preventing biomedical data from reaching its full potential in basic research, clinical, and translational medicine. DCPPC aims to improve this...
1,569
1.6K
data
eye 1,569
favorite 1
comment 0
A collection of fanfiction stories from fanfiction.net, repacked for easier bulk collecting and archiving. Contains many tens of thousands of fan fiction stories.
1,512
1.5K
data
eye 1,512
favorite 0
comment 0
Database of UPC product codes, as compiled by upcdatabase.com
Topics: UPC, Universal Product Code, barcode
This is the monthly dump of DISCOGS.ORG data, provided to the public domain. This dump has been generated and archived automatically. Official name is discogs_20130103 and the data is from 2013-01-03.
( 1 reviews )
This file is a snapshot dump of the Crossref DOI metadata API, containing entries for over 94 million DOIs. Compared to the previous 2017-03 version (see archive.org item "crossref_doi_dump_201703"), this snapshot has a few million more works, but the corpus size is much larger (29 GB compressed vs. 7 GB compressed) as it now contains significantly more citation data, due to the efforts of the Initiative for Open Citations (I4OC) project. This was generated by running the scripts...
1,213
1.2K
Feb 25, 2017
02/17
by
Various
data
eye 1,213
favorite 0
comment 0
CITY OF SCREENSHOTS is a dataset of automatically screenshotted computer programs taken from the uploaded items in the Internet Archive's software collection. An ever-growing dataset, it currently contains over 450,000 individual screenshot images from over 60,000 software programs for the Apple II, Atari 8-Bit, MS-DOS, Windows, ZX Spectrum and Tandy Color Computer. Screenshots were generated by automated script: An instance of Firefox would be spun up and aimed at the emulated item on the...
Topics: screenshots, computers, screens, artwork
1,156
1.2K
software
eye 1,156
favorite 0
comment 0
1,088
1.1K
data
eye 1,088
favorite 0
comment 1
MusicBrainz Database Dump 20141004-015144
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
A snapshot of the oaDOI DOI/URL database, including open access status for each paper. oaDOI is the API backing unpaywall; see oadoi.org for more details. This dataset is intended for NON-COMMERCIAL USE ONLY; contact oaDOI for details or commercial support.
938
938
software
eye 938
favorite 0
comment 0
929
929
data
eye 929
favorite 0
comment 0
Database of UPC product codes, as compiled by upcdatabase.com
Topics: UPC, Universal Product Code, barcode
This is the monthly dump of DISCOGS.ORG data, provided to the public domain. This dump has been generated and archived automatically. Official name is discogs_20110601 and the data is from 2011-06-01.
842
842
data
eye 842
favorite 0
comment 0
Minecraft Archive Project: MINECRAFTFORUM.NET
Manifest of Internet Archive's identified scholarly works in digital form (eg, journal articles). See README.html for details.
This is the monthly dump of DISCOGS.ORG data, provided to the public domain. This dump has been generated and archived automatically. Official name is discogs_20130301 and the data is from 2013-03-01.
798
798
software
eye 798
favorite 0
comment 0
782
782
software
eye 782
favorite 0
comment 0
Manifest of Internet Archive's identified scholarly works in digital form (eg, journal articles). See README.html for details.
777
777
software
eye 777
favorite 0
comment 0
771
771
software
eye 771
favorite 0
comment 0
770
770
Oct 19, 2017
10/17
by
NIST NSRL
data
eye 770
favorite 0
comment 0
The National Software Reference Library (NSRL) is designed to collect software from various sources and incorporate file profiles computed from this software into a Reference Data Set (RDS) of information. The RDS can be used by law enforcement, government, and industry organizations to review files on a computer by matching file profiles in the RDS. This will help alleviate much of the effort involved in determining which files are important as evidence on computers or file systems that have...
768
768
data
eye 768
favorite 0
comment 0
MusicBrainz Database Dump 20150523-002918
767
767
software
eye 767
favorite 0
comment 0
763
763
data
eye 763
favorite 0
comment 0
MusicBrainz Data Dump 20120623-002010
Topics: database, music, musicbrainz
760
760
data
eye 760
favorite 0
comment 0
openSNP is a community-driven and community-owned project which lives through the contributions of its members. It is not associated with any institution and the only funding source for openSNP is continuous crowdfunding , which pays for the hosting costs. openSNP allows customers of direct-to-customer genetic tests to publish their test results, find others with similar genetic variations, learn more about their results by getting the latest primary literature on their variations, and help...
This is the monthly dump of DISCOGS.ORG data, provided to the public domain. The data is in XML format and formatted according to the API spec: http://www.discogs.com/developers/. This dump has been generated and archived automatically. Official name is discogs_20080309 and the data is from 2008-03-09.
754
754
software
eye 754
favorite 0
comment 0
751
751
software
eye 751
favorite 0
comment 0
749
749
software
eye 749
favorite 0
comment 0
745
745
data
eye 745
favorite 0
comment 0
MusicBrainz Database Dump 20140215-002226
743
743
software
eye 743
favorite 0
comment 0
740
740
data
eye 740
favorite 0
comment 0
740
740
software
eye 740
favorite 0
comment 0
734
734
data
eye 734
favorite 0
comment 0
MusicBrainz Database Dump 20140329-003047
Downloaded from https://core.ac.uk/services "The data aggregated from repositories by the CORE system can be accessed in two ways, through the CORE API or by downloading the data to your computer. The former option is practical if you want to build a service on top of CORE while the latter is something we recommend to those who would like to analyse the CORE dataset and/or apply some computationally intensive batch processes. If you use CORE in your work, we kindly request you to cite one...
This is a backup of ROAD/ISSN metadata from http://road.issn.org/en/contenu/download-road-records Dumps in both MARC XML and RDF format are included; see sub-directory for date of download. See also earlier July 2017 dump at: https://archive.org/download/road-issn-2017 These files are under the Creative Commons Attribution-NonCommercial 4.0 International Public License (aka, CC-BY-NC).
Topic: metadata
726
726
data
eye 726
favorite 0
comment 0
MusicBrainz Database Dump 20140924-014210
724
724
software
eye 724
favorite 0
comment 0
712
712
software
eye 712
favorite 0
comment 0
711
711
data
eye 711
favorite 0
comment 0
MusicBrainz Database Dump 20150408-002807
711
711
software
eye 711
favorite 0
comment 0
709
709
data
eye 709
favorite 0
comment 0
MusicBrainz Database Dump: 20131012-002238
This item contains an annual copy of the ORCID public data file, as originally downloaded from: https://orcid.org/content/download-file More details about this content and it's use available at: https://orcid.org/content/orcid-public-data-file This dataset is available under the public domain (CC-0). The DOI of this dataset is: https://doi.org/10.6084/m9.figshare.5479792
This is the monthly dump of DISCOGS.ORG data, provided to the public domain. This dump has been generated and archived automatically. Official name is discogs_20121101 and the data is from 2012-11-01.
691
691
data
eye 691
favorite 1
comment 0
MusicBrainz Database Dump 20150124-024159
690
690
data
eye 690
favorite 0
comment 0
MusicBrainz Database Dump 20140705-002713
Manifest of Internet Archive's identified scholarly works in digital form (eg, journal articles). See README.html for details.
Unlike most ISSN metadata, this mapping file is publicly available.
This is the monthly dump of DISCOGS.ORG data, provided to the public domain. This dump has been generated and archived automatically. Official name is discogs_20120601 and the data is from 2012-06-01.
662
662
data
eye 662
favorite 0
comment 0
MusicBrainz Database Dump 20140716-002400
594
594
Jul 6, 2013
07/13
by
William W. Cohen, MLD, CMU
web
eye 594
favorite 2
comment 0
This dataset was collected and prepared by the CALO Project (A Cognitive Assistant that Learns and Organizes). It contains data from about 150 users, mostly senior management of Enron, organized into folders. The corpus contains a total of about 0.5M messages. This data was originally made public, and posted to the web , by the Federal Energy Regulatory Commission during its investigation. The email dataset was later purchased by Leslie Kaelbling at MIT, and turned out to have a number of...
Topics: Enron, E-mail, Dataset
Downloaded from https://doaj.org/csv and the OAI-PMH interface. File names encode the date when data was downloaded.
566
566
May 22, 2017
05/17
by
Safecast
data
eye 566
favorite 0
comment 0
This item contains backups of measurement data from the Safecast environmental monitoring project: https://safecast.org From their webpage: "Safecast is an international, volunteer-centered organization devoted to open citizen science for the environment. After the devastating earthquake and tsunami which struck eastern Japan on March 11, 2011, and the subsequent meltdown of the Fukushima Daiichi Nuclear Power Plant, accurate and trustworthy radiation information was publicly unavailable....
Topics: radiation, community science
Downloaded from https://doaj.org/csv and the OAI-PMH interface.
449
449
data
eye 449
favorite 0
comment 0
Database of UPC product codes, as compiled by upcdatabase.com http://sourceforge.net/projects/upcdatabase/
Topics: UPC, Universal Product Code, barcode
This item contains snapshots of the Datacite OAI-PHM metadata feed, as captured with the tool 'metha'.
420
420
movies
eye 420
favorite 0
comment 0
Videos from Day 1 of the May NIH DCPPC Collaboration Workshop The 2018 May DCPPC workshop took place on May 30-31 in Boston in the Countway Library of Medicine at the Harvard School of Public Health in Boston, MA. These videos are of the lightning talks at the start of the first day of the workshop. Each team provided a 5-ish minute summary of what they had been working on. Videos Charles Reid of Team Copper Cricket Sloan of Team Calcium Paul Avillach of Team Calcium Claris Castillo of Team...
Topics: dcppc, commonspilot
410
410
data
eye 410
favorite 0
comment 0
MusicBrainz Database Dump 20140611-002358
410
410
data
eye 410
favorite 0
comment 0
MusicBrainz Database Dump 20140806-002953
396
396
movies
eye 396
favorite 0
comment 0
Videos from Day 2 of the May NIH DCPPC Collaboration Workshop The 2018 May DCPPC workshop took place on May 30-31 in Boston in the Countway Library of Medicine at the Harvard School of Public Health in Boston, MA. These videos are of the lightning talks at the start of the second day of the workshop. Each team provided a 5-ish minute summary of what they planned to work on next. Videos Rayna Harris from Team Copper Sasha Wait Zaranek from Team Copper Brad Heavner from TopMed Data Stewards Team...
Topics: dcppc, commonspilot
367
367
Apr 19, 2018
04/18
by
Stack Exchange, Inc.
data
eye 367
favorite 0
comment 0
This is intended to be an exact copy of the item "stackexchange" (https://archive.org/details/stackexchange) as of 2018-03-14. That item is continuously updated by Stack Exchange (which is great!); this snapshot could be helpful if something goes wrong with that process, or might be helpful for researchers if the upstream schema changes or to check for missing/changed data. See the "upstream" item for details and license/policy details.
356
356
data
eye 356
favorite 0
comment 0
MusicBrainz Database Dump: 20130612-002814
